Compiling CNNs with Cain: focal-plane processing for robot navigation

نویسندگان

چکیده

Abstract Focal-plane Sensor-processors (FPSPs) are a camera technology that enables low power, high frame rate computation in the image sensor itself, making them suitable for edge computation. To fit into array, FPSPs highly resource-constrained, with limited instruction set and few registers - which makes developing complex algorithms difficult. In this work, we present Cain, compiler convolutional filters targets SCAMP-5, general-purpose FPSP. Cain generates code to evaluate multiple kernels at same time. It avoids need hardware multipliers, while orchestrating exploitation of common sub-terms—leading large reduction count compared both straightforward prior optimized approaches. We demonstrate capability enabled by on SCAMP-5 robotic navigation near-sensor high-speed low-power computation, using implement neural network focal plane.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Focal-Plane and Multiple Chip VLSI Approaches to CNNs

In this paper, three alternative VLSI analog implementations of CNNs are described, which have been devised to perform image processing and vision tasks: a programmable low-power CNN with embedded photosensors, a compact fixed-template CNN based on unipolar current-mode signals, and basic CMOS circuits to implement an extended CNN model using spikes. The first two VLSI approaches are intended f...

متن کامل

Focal-Plane Optical Flow Computation by Foveated CNNs

Optical flow computation is instrumental in robot guidance. Optoelectronic smart-pixel sensors for such computation may be realized on a single chip, by making use of a suitable Cellular Neural Network architecture defined on a log-polar space-variant grid. Simulations confirm validity of the filtering system, and possible realizable structures are discussed.

متن کامل

Architectures for focal plane image processing

Architectures for focal plane image processing are discussed. On-chip image preprocessing for solid-state imagers using analog CCD circuits is described for low, medium, and high density detector arrays. A spatially parallel architecture for low density, high throughput applica­ tions is described. For sparse illumination or event detection, a content· addressable architecture is proposed. A ne...

متن کامل

FOCAL POINT AND FOCAL K-PLANE

This paper deals with the basic notions of k-tautimmersions . These notions come from two special cases; that is, tight and taut immersions. Tight and taut based on high and distance functions respectively and their basic notions are normal bundle, endpoint map, focal point, critical normal. We generalize hight and distance functions to cylindrical function and define basic notions of k-taut ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Autonomous Robots

سال: 2022

ISSN: ['0929-5593', '1573-7527']

DOI: https://doi.org/10.1007/s10514-022-10053-w